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A mid a national education conversation fraught with themes of dropout factories and 
achievement gaps, educators, researchers, and policymakers are striving to identify 
factors that characterize successful public schools. A growing body of research suggests 
that school climate may be an important variable in explaining why some schools 
are more successful than others. School climate includes such factors as a school’s 
order, safety, and discipline; supports for teaching and learning; personal and social 
relationships; and school connectedness. 


Positive school climate has been associated with better 
student academic achievement, graduation, and behav- 
ioral outcomes, and has been the focus of several recent 
initiatives for school reform, including the federal Safe 
and Supportive Schools program . 1 

The study, A Climate for Academic Success: How School 
Climate Distinguishes Schools That Are Beating the 
Achievement Odds, contributes to this research by 
exploring the climate of a handful of secondary schools 
with extraordinary success compared to that of other 
schools, including those that consistently underper- 
form. School success is often defined in absolute terms, 
such as average standardized test scores. But such 
criteria are known to be strongly correlated with the 
socioeconomic characteristics of a school’s student 
body. And the fact that a largely affluent student body 


is linked to school success offers little useful direction 
for those trying to improve achievement in struggling 
schools with low-income student populations. 

To address this limitation, the present study’s design 
and methodology take student characteristics into 
account. Specifically, a successful school is defined 
as one whose test scores are better than would be 
predicted based on its student characteristics. Using 
this definition, A Climate for Academic Success inves- 
tigated how two factors, school climate and school 
personnel resources — used for comparison in data analy- 
sis — differed among three groups of California secondary 
schools: those that performed much better across multiple 
years than their student characteristics would predict, 
referred to as beating-the-odds (BTO) schools ; 2 those that 
performed much worse than would be predicted over 
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Positive school climate 
has been associated with 
better student academic 
achievement, graduation, 
and behavioral outcomes, 
and has been the target of 
several recent initiatives for 
school reform. 


multiple years, referred to as chronically underperforming 
(CU) schools; and other secondary schools. 

Using a sample of 1,715 California middle and high 
schools, the study revealed these key findings: 

» The 40 BTO schools (2.4 percent of the sample) had 
substantially more positive school climates than 
both the 20 CU schools (1.2 percent) and all other 
secondary schools (96.4 percent). 

» BTO schools had climate scores at the 82nd 
percentile, on average, whereas other secondary 
schools were at the 49th percentile, on average. 

» Differences in school climate were twice as large 
between BTO schools and CU schools. 

» The probability of beating the odds for a school 
with a climate in the top five percent is over ten 
times that of a school with an average climate. 

This report summary describes selected research 
informing A Climate for Academic Success', methodology 
and data sources; and findings related to the three ques- 
tions guiding the study. Those questions are: 

» What are the reported differences in school 
climate by students in successful versus unsuc- 
cessful schools? 


» How are school climate and personnel resources, 
respectively, related to the likelihood of 
academic success? 

» What are the practical implications of these 
findings for improving the academic performance 
of schools? 

What the research says 

Successful-schools approach 

The successful-schools approach has traditionally been 
used by education-finance scholars to determine appro- 
priate school expenditure levels. Researchers define 
success, they calculate how much successful schools 
are spending, and this spending figure becomes a sort 
of norm for the resources required to make schools 
successful. However, as argued in a report by the 
American Institutes for Research, 3 using absolute crite- 
ria to define adequate resources for success is overly 
simplistic and ignores the impact of student character- 
istics on resource needs. Schools that serve students 
who are predominantly low-income and/or have special 
needs are likely to have higher resource needs per 
student. If such schools are systematically excluded 
from being identified as successful, the results of any 
analysis linking resources and success will be biased. 

A Climate for Academic Success appropriates the 
elegance of the successful-schools model, while also 
accounting for demographics. 

Effective schools 

There is a rich body of research on identifying the 
characteristics of successful or effective schools. In large 
part, this research grew from the findings of the Coleman 
Report, 4 which stressed student demographics as the 
most salient predictor of academic success. For decades, 
research on effective schools has boiled down to a hand- 
ful of factors: leadership, relationships, and teaching and 
learning, to put it most generally. Purkey and Smith 5 
referred to these factors collectively as school culture or 


[\J 


school climate, identifying them as the most important 
factors enabling a school to facilitate student achievement. 
In a review of over 300 studies commissioned by the U.S. 
Department of Education, 6 the predictors of effectiveness 
were high expectations, parent involvement, staff develop- 
ment, and more intimate learning environments, along 
with initiatives to connect learning with students’ inter- 
ests and career plans. Factors identified by Marzano, 7 
in a more recent review, overlapped heavily with those 
already mentioned. These findings have been further 
corroborated by a comprehensive empirical study of 
Chicago public schools by Bryk and colleagues. 8 

School climate 

The terms "school culture” and “school climate” 
have regained prominence in education only in the 


last several years. A positive school climate has been 
associated with higher academic achievement and 
healthy behavioral outcomes for students. Brand and 
colleagues 9 found multiple dimensions of school climate 
to be significantly associated with student academic, 
behavioral, and socioemotional well-being in a large, 
nationally representative sample of middle school 
students. The association between climate and achieve- 
ment has been confirmed in data from California 
middle and high schools. 10 Patton and colleagues 11 
conducted one of the few documented randomized 
trials involving school climate, which showed that an 
intervention designed to enhance school connectedness 
and student engagement had the effect of reducing 
the frequency of student health-risk behaviors and 
substance use. 


Methodology and data sources 

Sample 

The sample for this analysis included 1,715 California middle and high schools that administered the California 
Healthy Kids Survey (CHKS), a project of the California Department of Education (CDE), during the 2008/09 and 
2009/10 school years. Beating-the-odds and chronically underperforming schools were identified based on the 
difference between their actual state standardized test performance between the 2007/08 and 2010/11 school years 
and their predicted performance in consideration of their student demographics, as identified through the California 
Basic Educational Data System (CBEDS). To be classified as BTO or CU, a school had to outperform or underperform, 
respectively, in all four years for middle schools and the latter three years for high schools. 

Measures 

School climate was measured using the School Climate Index (SCI), a school-level indicator developed for the 
CDE’s Safe and Supportive Schools program using aggregated student self-report data from the CHKS. The SCI 
also includes truancy data from CBEDS. The SCI ranges from 100 to 500, with a mean of 300 and a standard devi- 
ation of 50. 

A school’s personnel resources 12 are an alternative explanation for academic success and included in this analysis to 
isolate the relationship between climate and success. Data on personnel resources, as well as school demographic data (e.g., 
racial composition, proportion of students receiving free or reduced-price meals) were derived from CBEDS. Academic 
performance indicators were accessed through the California Standardized Testing and Reporting program and 
included middle school English language arts (ELA) and math scores on the California Standards Tests (CST) and 
high school ELA CST and math scores in grade 10 on the California High School Exit Examination. 


Answers to 
research questions 


Figure 1. School Climate in Beating-the-Odds, Chronically 
Underperforming, and Other Schools 



BTO schools CU schools Other schools 


Figure 2. A School's Probability of Beating the Odds, 

Based on Its School Climate Index and Personnel Resources 



School Climate Index — — Personnel Resources 


What are the reported differences 
in school climate by students in 
successful versus unsuccessful 
schools? 

Do BTO and CU schools have different 
school climates compared to each other, 
as well as to other public secondary 
schools in California? The data suggest 
that they do. Figure 1 depicts the SCI 
differences across BTO, CU, and other 
secondary schools. BTO schools had 
much higher SCIs than other schools 
(346 versus 299, respectively). Expressed 
in percentiles, the difference in SCI 
between BTO and other schools was 33 
percentiles (82nd and 49th, respectively). 

The difference in SCI between BTO 
and CU schools was more than twice 
as large: 68 percentiles (82nd and 14th, 
respectively). These are dramatic differ- 
ences by social-science standards. 

One explanation for these school climate 
gaps among BTO, CU, and other schools 
might be that there are unmeasured 
factors that underlie both school climate 
and performance. For example, BTO 
schools also had smaller enrollments, 
fewer students in poverty, and more 
personnel resources (e.g., teachers per 
student and experienced teachers and 
administrators). These differences may 
explain both BTO status and school climate. However, 
analyses that controlled for these factors confirmed 
that, student demographics, school size, and personnel 
resources being equal, BTO schools still had more posi- 
tive climates, and CU schools had less positive climates 
than other schools. 


How are school climate and personnel 
resources, respectively, related to the likelihood 
of academic success? 

In this analysis, school climate, personnel resources, 
and student demographics were each treated as predic- 
tors of a school’s likelihood of beating the odds. A 
school’s SCI had the strongest association with its 





likelihood of beating the odds. Figure 2 shows that, in 
an average secondary school in California, the prob- 
ability of beating the odds increased as both SCI and 
personnel resources increased, but the increase in 
probability was much higher for school climate. In an 
average California secondary school, where the mean 
for both SCI and personnel resources was set at 0 for 
purposes of analysis, the probability of beating the 
odds was very low, only about 1 percent. As the SCI 
improved, the probability of beating the odds increased 
exponentially. Figure 2 shows the probabilities of 
beating the odds associated with SCIs and personnel 
resources between -2.5 and 2.5 standard deviations 
from the mean. 

» An SCI of 350, one standard deviation above the 
mean, is associated with a 3.5 percent probability 
of beating the odds. 

» An SCI of 400, two standard deviations above the 
mean, is associated with a 10.6 percent probability 
of beating the odds, or ten times higher than for an 
average school. 

» An SCI of 425, two and a half standard devi- 
ations above the mean, is associated with a 
17.8 percent probability of beating the odds. 


Moreover, a school that has an SCI equal to the highest 
SCI value in the sample (480, or 3.6 standard deviations) 
has a 44.5 percent estimated probability of beating 
the odds (not shown in Figure 2). In contrast, while 
increases in personnel resources are also associated with 
increases in probabilities of beating the odds, the effect 
is much smaller. With a level of personnel resources 
two standard deviations above the mean, there is only a 
2.8 percent probability of beating the odds. 



What are the practical implications of 
these findings for improving the academic 
performance of schools? 

This study adds to the large and growing body of 
research demonstrating that safe and supported 
students perform better in school. While the likelihood 
of beating the odds is low for all public middle and high 
schools in California, an exceptional school climate is 
associated with an exponentially higher probability. 

In contrast, the results suggest that school climate has 
more to do with BTO than personnel resources do. 

Even in a school with the optimal level of personnel 
resources, the probability of beating the academic 
achievement odds is still only 3.9 percent. For student 
demographics, the association with BTO probability is 
not significantly different from that with school climate. 
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While the likelihood of beating 
the academic achievement odds 
is low for all public middle and 
high schools in California, an 
exceptional school climate is 
associated with an exponentially 
higher probability. 


Enrollment appears to be the main driver of the asso- 
ciation between student demographics and BTO, with 
smaller student bodies predicting a greater likelihood 
of BTO. 

It is prudent to refer to the relationship between school 
climate and school success as "association,” rather than 
as “cause and effect," however tempting it may be to 
assert causality. While this study addresses some alter- 
native explanations for why school climate and perfor- 
mance are related, there are many potential factors not 
included in this study that could affect both of these 
variables. Nevertheless, it is clear from the results of 
this analysis that BTO schools have significantly more 
positive school climates. 

Future research could build on the work of this study by 
looking at the relationship between school climate and 
success over time to better assess causality. Additional 
research could use the schools identified as BTO in this 
study as model cases from which to learn about best 
practices for school success and school climate. 

There is little question that students’ demographics are 
a major determinant of their academic success and that 
broad initiatives are needed that target the social forces 
that make low-income, racial-minority, and English 
learner students less successful in school. 

As noted earlier in this report summary, however, many 
characteristics that have been statistically shown to put 


students at a disadvantage — such as race, socioeconomic 
status, first language, and special needs — are not within 
a school’s or district’s ability to address alone. The 
approach employed in this study helps direct the focus 
of research toward characteristics of schools that can 
be targeted through intervention and changed. School 
climate is a malleable factor that schools or districts are 
able to manipulate. 

Among the more commonly employed strategies for 
improving climate at the school level are schoolwide 
prevention approaches that involve all staff in the instal- 
lation of a behavior management system, and student 
social and emotional learning approaches that rely on 
classroom social-skills instruction. For example, some 
schools have implemented restorative justice programs — 
as opposed to traditional, punitive discipline codes — that 
focus on the relationship between the perpetrator of 
misbehavior and members of the school community, 
including potential victims and their families. Another 
example is transformative classroom management 
that leverages students’ motivation and engagement to 
increase adherence to classroom behavioral norms. 

This study suggests that a positive school climate 
may be beneficial for all schools, serving all types 
of students. This news is especially encouraging for 
schools whose students face socioeconomic barriers to 
academic success. These schools must beat the odds to 
achieve conventional levels of success. This study shows 
that certain schools are beating the odds and achieving 
extraordinary academic outcomes, and these schools 
have a positive school climate in common. 


To view the full report from which this summary was compiled, A Climate 
for Academic Success: How School Climate Distinguishes Schools That 
Are Beating the Achievement Odds (Research Report), go to: 
h ttp://www. wes ted. org/cs/we/view/rs/1 310. 
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For more information 

» For more information on assessing school climate and on the CHKS, see Austin, G., O’Malley, M., & Izu, J. 
(2011). Making sense of school climate. San Francisco: WestEd. Available for download at 
http://californias3.wested.org/resources/S3_schoolclimateguidebook_final.pdf. 

» For information on the development and use of the School Climate Index, see Hanson, T. (2012). Construction of 
California's School Climate Index (SCI) for high schools participating in the Safe and Supportive Schools program. 
San Francisco: WestEd. Download at: http://californias3.wested.org/resources/SCI_Methodology071712b.pdf. 
The SCI is used in preparation of School Climate Report Cards, which can be downloaded from 
http://californias3.wested.org. 
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